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Abstract 


The  speech  intelligibility  of  a  personal  role  radio  (PRR)  with  integrated  hearing  protection 
headsets  (IHPH)  was  investigated.  The  standard  PRR  communication  headset  is  comprised  of  a 
one-sided  earcup  and  a  boom  microphone,  and  does  not  provide  hearing  protection.  IHPH 
devices  provide  simultaneous  hearing  protection,  communication  and  enhanced  hearing 
capability.  Two  different  tests  of  speech  intelligibility  were  used  (modified  rhyme  test  [MRT] 
and  speech  perception  in  noise  [SPIN])  to  evaluate  the  quality  of  radioed  speech  over  the  standard 
PRR  headset  (SH),  the  Nacre  QuietPro®  (QP)  and  the  Silynx  QuietOps™  (QO).  The  highest 
scores  on  the  MRT  and  SPIN  tests  in  background  noise  were  obtained  using  the  SH,  followed  by 
the  QP  and  the  QO.  However,  the  QP  was  given  a  higher  total  user  acceptance  rating  score  than 
the  SH.  Both  the  QP  and  SH  were  rated  relatively  higher  than  the  QO.  Given  that  hearing 
protection  will  be  required  in  most  operational  environments,  the  QP  provided  the  best 
combination  of  speech  quality,  hearing  protection  and  usability. 


Resume 


L’intelligibilite  de  la  parole  en  provenance  d’un  poste  radio  personnel  (PRR)  muni  de  casques 
d’ecoute  avec  dispositif  integre  de  protection  de  I’ouie  (DIPO)  a  fait  Tobjet  d’une  evaluation.  Le 
casque  d’ecoute  reglementaire  avec  microphone  dont  est  equipe  le  PRR  se  compose  d’une  seule 
coupelle  a  oreille  et  d’un  microphone  monte  sur  tige  et  n’offre  aucune  protection  de  I’ouie.  Les 
DIPO  offfent  a  la  fois  protection  de  Toui'e,  capacite  de  communication  et  capacite  auditive 
accrue.  Deux  tests  differents  d’intelligibilite  de  la  parole  (le  test  MRT  anglais  de  rimes  modifiees 
et  le  test  SPIN  anglais  de  perception  de  la  parole  en  presence  de  bruit)  ont  servi  a  evaluer  la 
qualite  de  la  sortie  de  parole  sur  le  casque  d’ecoute  reglementaire  du  PRR  (casque  reglementaire), 
le  casque  Nacre  QuietPro®  (QP)  et  le  casque  Silynx  QuietOps™  (QO).  Dans  le  cas  du  MRT  et  du 
SPIN  administres  avec  bruit  de  fond,  le  casque  reglementaire  a  affiche  les  meilleurs  resultats, 
suivi  du  casque  QP  et  ensuite  du  casque  QO.  Le  casque  QP  a  obtenu  un  meilleur  resultat  total  que 
le  casque  reglementaire  en  ce  qui  concerne  Tacceptation  par  Tutilisateur.  Le  casque  QP  et  le 
casque  reglementaire  ont  obtenu  tous  les  deux  un  resultat  relativement  superieur  a  celui  du  casque 
QO.  Etant  donne  que  la  plupart  des  environnements  operationnels  exigeront  un  dispositif  de 
protection  de  Toui'e,  le  casque  QP  offre  la  meilleure  option  combinant  qualite  de  la  parole, 
protection  de  Tou'ie  et  facilite  d’emploi. 
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Executive  summary 


Effects  of  Integrated  Hearing  Protection  Headsets  on  the  Quality 
of  Radio  Communications: 

Ann  Nakashima;  Sharon  M.  Abel;  DRDC  Toronto  TR  2009-074;  Defence  R&D 
Canada  -  Toronto;  July  2009. 

Background:  Communication  between  soldiers  on  the  ground  is  often  hindered  by  various  types 
of  noise.  The  noise  can  be  continuous  (e.g.,  vehicle  noise)  or  impulsive  (e.g.,  gunfire  and  blasts). 
Conventional  radio  headsets  do  not  provide  hearing  protection,  and  conventional  hearing 
protection  devices  have  a  negative  impact  on  communication  and  the  ability  to  localize  sounds, 
decreasing  situational  awareness.  It  is  of  interest  to  consider  integrated  solutions  to  find  the  best 
combination  of  hearing  protection,  communication  capability  and  usability  in  the  field.  In  this 
study,  speech  intelligibility  was  tested  using  the  personal  role  radio  (PRR),  which  is  standard 
issue  for  Canadian  Forces  (CF)  dismounted  soldiers.  The  PRR  was  used  with  a  standard  headset 
(SH;  one-sided  earcup,  no  hearing  protection)  and  two  integrated  hearing  protection  devices:  the 
Nacre  QuietPro®  (QP)  and  the  Silynx  QuietOps™  (QO).  A  secondary  objective  was  to  obtain 
user  acceptance  ratings  by  means  of  a  questionnaire. 

Method:  Five  male  subjects  with  normal  hearing  thresholds  and  who  were  fluent  in  English 
participated  in  the  study.  Subjects  performed  two  tests  of  speech  intelligibility  in  75  dBA 
background  noise:  the  Modified  Rhyme  test  (MRT)  and  the  Speech  Perception  in  Noise  test 
(SPIN).  The  tests  were  conducted  using  one  subject  as  the  talker  and  a  second  subject  as  the 
listener.  During  each  experimental  session,  the  subject  pair  alternated  roles  as  talker  and  listener, 
and  completed  the  MRT  and  SPIN  tests  using  each  of  the  three  headsets.  A  questionnaire 
probing  headset  user  acceptance  was  administered  after  each  headset  was  used.  Subjects  were 
paired  such  that  all  possible  subject  combinations  were  used;  therefore,  each  subject  participated 
in  four  sessions  for  a  total  of  10  experimental  sessions. 

Results:  For  the  MRT,  subjects  performed  the  best  using  the  standard  PRR  headset  (SH,  89%), 
followed  by  the  QP  (83%)  and  then  the  QO  (70%).  Performance  using  the  SPIN  followed  a 
similar  trend:  93%  for  the  SH,  87%  for  the  QP  and  70%  for  the  QO.  Performance  on  both  of  the 
tests  was  significantly  better  using  the  SH  than  both  the  QP  and  QO.  Mean  user  acceptance 
scores  were  highest  for  the  QP  (48.8),  followed  closely  by  the  SH  (47.6).  Both  were  rated 
relatively  higher  than  the  QO  (35.9). 

Significance:  Given  that  military  personnel  will  be  required  to  wear  hearing  protection  in  most 
operational  environments,  of  the  three  headsets  tested  the  QP  provided  the  best  combination  of 
speech  quality,  hearing  protection  and  user  acceptance. 

Future  plans:  It  may  be  of  interest  to  consider  speech  intelligibility  and  user  acceptance  of  the 
SH  in  combination  with  earplugs  that  offer  protection  from  impulse  noise  and  talk-through 
capability.  This  would  provide  an  alternative,  lower-cost  solution  for  integrated  hearing 
protection  and  communication  in  the  field. 


iii 


DRDC  Toronto  TR  2009-074 


Sommaire 


Effects  of  Integrated  Hearing  Protection  Headsets  on  the  Quality 
of  Radio  Communications: 

Ann  Nakashima;  Sharon  M.  Abel;  DRDC  Toronto  TR  2009-074;  R  &  D  pour  la 
defense  Canada  -  Toronto;  Julliet  2009. 

Contexte:  Divers  types  de  bruit  viennent  souvent  alterer  la  communication  entre  les  soldats  sur  le 
terrain.  II  pent  s’agir  d’un  bruit  continu  (p.  ex.,  le  bruit  d’un  vehicule)  ou  impulsionnel  (p.  ex.,  un 
tir  de  canon  ou  une  explosion).  Les  casques  d’ecoute  traditionnels  n’offrent  aucune  protection  de 
Louie  alors  que  les  dispositifs  traditionnels  de  protection  de  Louie  nuisent  a  la  communication  et 
a  la  capacite  de  localiser  la  source  du  bruit,  ce  qui  limite  la  connaissance  de  la  situation.  II 
convient  done  d’ examiner  des  solutions  mixtes  afm  de  trouver  le  casque  qui  offre  la  meilleure 
combinaison  de  protection  de  Louie,  de  capacite  de  communication  et  de  facilite  d’emploi  sur  le 
terrain.  Dans  Letude,  Levaluation  de  Lintelligibilite  de  la  parole  a  etc  effectuee  a  partir  du  poste 
radio  personnel  (PRR),  lequel  constitue  un  article  reglementaire  pour  les  soldats  debarques  des 
Forces  canadiennes.  Le  PRR  a  etc  evalue  avec  un  casque  d’ecoute  reglementaire  (une  seule 
coupelle  a  oreille  et  aucune  protection  de  Louie)  et  avec  deux  dispositifs  integres  de  protection  de 
Louie  :  le  Nacre  QuietPro®  (QP)  et  le  Silynx  QuietOpsTM  (QO).  Parallelement,  on  a  evalue  le 
degre  d’acceptation  de  Lutilisateur  a  Laide  d’un  questionnaire. 

Methode:  Cinq  hommes  ayant  un  seuil  d’audition  normal  et  parlant  couramment  anglais  ont  pris 
part  a  Letude.  Les  sujets  ont  effectue  les  deux  tests  d’intelligibilite  de  la  parole  (le  test  MRT 
anglais  des  rimes  modifiees  et  le  test  de  SPIN  anglais  perception  de  la  parole  en  presence  de 
bruit)  avec  un  bruit  de  fond  de  75  dBA.  Pour  chaque  test,  un  sujet  remplissait  le  role  de  celui  qui 
parle  et  un  autre  sujet,  le  role  de  celui  qui  ecoute.  Ils  inversaient  ensuite  les  roles  et  repetaient 
Lexperience  avec  chacun  des  trois  casques  d’ecoute.  Apres  Lutilisation  de  chaque  casque 
d’ecoute,  le  sujet  remplissait  un  formulaire  sur  Lacceptation  de  Lutilisateur.  Les  sujets  ont  etc 
jumeles  de  telle  sorte  que  toutes  les  combinaisons  possibles  soient  realisees.  Ainsi,  chaque  sujet  a 
participe  a  quatre  seances,  pour  un  total  de  dix  seances  experimentales. 

Resultats:  Dans  le  cas  du  MRT,  les  sujets  ont  affiche  les  meilleurs  resultats  avec  le  casque 
reglementaire  du  PRR  (89  %),  suivaient  ensuite  les  resultats  pour  le  QP  (83  %)  et  ceux  pour  le 
QO  (70  %).  Les  resultats  presentaient  la  meme  tendance  dans  le  cas  du  SPIN  :  a  savoir,  93  % 
(casque  reglementaire);  87  %  (QP)  et  70  %  (QO).  Dans  le  cas  des  deux  tests,  le  casque 
reglementaire  a  donne  de  bien  meilleurs  resultats  que  les  casques  QP  et  QO.  En  moyenne,  le  taux 
d’acceptation  de  Lutilisateur  etait  superieur  dans  le  cas  du  casque  QP  (48,8  %),  suivi  de  pres  par 
celui  du  casque  reglementaire  (47,6  %).  Ces  deux  casques  ont  obtenu  une  cote  relativement 
superieure  a  celle  du  casque  QO  (35,9  %). 

Importance:  Etant  donne  que  le  personnel  militaire  devra  porter  un  dispositif  de  protection  de 
Louie  dans  la  plupart  des  environnements  operationnels,  le  casque  QP  est  celui  qui,  des  trois 
casques  d’ecoute  evalues,  constitue  la  meilleure  option  combinant  protection  de  Louie,  capacite 
de  communication  et  facilite  d’emploi. 

Perspectives:  II  conviendrait  peut-etre  d’evaluer  Lintelligibilite  de  la  parole  et  Lacceptation  de 
Lutilisateur  dans  le  cas  du  casque  reglementaire  utilise  avec  bouchons  d’oreille,  lesquels 
protegent  contre  le  bruit  impulsionnel  tout  en  permettant  la  communication.  Cette  formule 
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offrirait  une  solution  de  rechange  economique  qui  permettrait  d’ assurer  la  protection  de  Touie  et 
la  communication  sur  le  terrain. 
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IX 


1  Introduction 


The  effects  of  conventional  hearing  protection  devices  on  speech  intelligibility  have  been  studied 
for  many  decades  (e.g.  Kryter,  1946;  Abel  et  al,  1982).  Military  operational  environments  are 
highly  dynamic,  containing  high  noise  levels  with  a  broad  range  of  frequencies  and  temporal 
characteristics.  Military  personnel  require  equipment  that  will  not  only  protect  them  from  high 
noise  exposure,  but  also  allow  them  to  communicate  with  other  crew  or  platoon  members.  Over 
the  years,  new  technologies  have  been  developed  to  address  these  demands.  For  example,  the 
incorporation  of  active  noise  reduction  (ANR)  technology  in  earmuffs  has  led  to  both  improved 
communications  and  hearing  protection  in  aircraft  (Gower  and  Casali,  1994;  McKinley  et  al., 
1996). 

To  date,  much  of  the  work  on  the  intelligibility  of  radio  communications  has  focused  on  aircraft 
(e.g.  Ribera  et  al,  2004).  Communication  between  soldiers  on  the  ground,  whether  mounted  or 
dismounted,  is  also  of  critical  importance.  Soldiers  on  the  ground  may  be  exposed  to  various 
types  of  noise,  from  continuous  noise  inside  an  armoured  personnel  carrier  to  high  intensity 
impulse  noise  from  gunfire  and  blasts.  Conventional  radio  headsets  do  not  provide  hearing 
protection,  while  conventional  hearing  protection  devices  (FIPDs)  have  a  negative  impact  on 
communication  and  the  ability  to  localize  sounds,  which  decreases  situational  awareness.  This  is 
particularly  true  for  individuals  with  pre-existing  hearing  loss  (Abel  et  al.,  1993).  To  address 
these  problems,  integrated  hearing  protection  headsets  (IFIPFI)  have  been  developed.  IFIPFI 
systems  combine  communication  capability  with  hearing  protection.  The  insert  earplugs  contain 
transducers  which  serve  several  purposes:  1)  to  feed  the  incoming  communication  channel 
through  to  the  ear,  2)  to  transmit  the  outgoing  communication  from  the  user  (may  be  a 
microphone  that  is  integrated  into  the  earplug  or  an  external  boom  microphone),  3)  to  capture 
ambient  sounds  and  feed  them  through  to  the  ear  and  4)  to  provide  ANR.  It  has  been  shown  that 
IHPH  systems  allow  for  improved  sound  localization  capability  over  conventional  headsets  (Abel 
et  al.,  2007). 

In  order  to  maintain  situational  awareness,  dismounted  soldiers  must  have  both  protection  from 
high  noise  levels  and  the  ability  to  communicate  effectively  by  radio.  It  has  already  been 
determined  that  IHPH  devices  can  provide  adequate  hearing  protection  and  sound  localization 
capability.  In  this  study,  the  quality  of  speech  communication  that  is  afforded  by  these  devices 
was  investigated.  A  secondary  objective  was  to  obtain  user  acceptance  ratings  by  means  of  a 
questionnaire.  The  study  was  designed  to  conform  to  the  American  National  Standard  for 
measuring  the  intelligibility  of  speech  over  communication  systems  (ANSI  S3.2-1989  (R1999)). 
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2  Method 


2.1  Subjects 

ANSI  S3.2-1989  (R1999)  lists  the  following  criteria  for  selection  of  subjects  (ANSI,  1999): 

•  At  least  five  talkers  and  at  least  five  listeners  shall  be  used; 

•  The  number  of  talkers  shall  be  equal  to  or  greater  than  the  number  of  listeners; 

•  The  sample  of  talkers  and  listeners  shall  be  representative  of  the  expected  user  population; 

•  Subjects  shall  have  hearing  thresholds  that  are  no  higher  than  +20  dB  HL  and  no  lower  than 
-10  dB  HL  at  frequencies  between  125  and  8000  Hz. 

Five  male  subjects  (age  range  22-39  years)  who  were  fluent  in  English  participated  in  this  study. 
All  subjects  were  screened  for  a  history  of  ear  disease  and  hearing  thresholds  greater  than  20  dB 
HL  bilaterally  between  0.25  kHz  and  8  kHz.  Accurate  results  were  not  obtained  for  0.125  kHz 
due  to  equipment  limitations.  Subjects  were  asked  to  avoid  loud  noise  or  music  exposure  for  24 
hours  before  each  experimental  session. 

Protocol  approval  was  obtained  from  the  Human  Research  Ethics  Committee  (HREC)  of  Defence 
Research  and  Development  Canada  (DRDC).  Participants  were  recruited  from  within  DRDC 
Toronto  and  the  Land  Force  Central  Area  (LFCA)  at  the  Denison  Armoury  in  Toronto.  Subjects 
gave  their  written  consent  prior  to  participating  in  the  experiment  and  were  remunerated  for  their 
participation  according  to  guidelines  established  by  DRDC  Toronto. 


2.2  Apparatus 

The  experiment  was  conducted  in  the  Noise  Simulation  Facility  at  Defence  Research  and 
Development  Canada  -  Toronto  (DRDC  Toronto)  The  facility  is  a  semi-reverberant  room  (1 1  x 
6x3  m^)  with  an  ambient  of  about  28  dB  SPL.  The  background  noise  (75  dBA  pink  noise)  was 
presented  from  an  array  of  8  sub-low  (Gane  G218),  2  low  (ServoDrive  Bass  Tech  7),  4  mid- 
(ElectroVoice)  and  4  high-frequency  (Electro Voice)  loudspeakers,  powered  by  twelve  Bryson 
amplifiers  (stereo  model  4B  and  mono  model  7B).  For  details  see  Nakashima  and  Borland,  2005. 
The  array  spanned  the  shorter  wall  of  the  room,  facing  the  subjects  at  a  distance  of  4.7  m  .  The 
subjects  were  seated  2.2  m  apart,  separated  by  a  barrier  (Figure  1).  The  subject  positions  were 
chosen  such  that  the  background  noise  spectra  were  matched.  The  noise  spectra  at  the  two 
positions  are  shown  in  Figure  2. 
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Figure  1:  Experimental  setup  in  the  Noise  Simulation  Facility. 


Figure  2:  Background  noise  spectra  (pink  noise,  total  75  dBA)  at  the  two  subject  positions. 

The  subjects  communicated  using  Personal  Role  Radios  (PRR;  Marconi  Selenia 
Communications),  which  are  standard  issue  in  the  Canadian  Forces  (CF)  for  dismounted  soldiers. 
Three  different  headsets  were  used  in  combination  with  the  PRR:  the  standard  PRR  headset  (SFI), 
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a  Nacre  QuietPro®  headset  (QP)  and  a  Silynx  QuietOps™  headset  (QO)  (see  Figure  3).  The  SFI 
consists  of  a  one-sided  earcup  for  listening  and  a  boom  microphone  for  talking.  The  QP  and  QO 
offer  hearing  protection,  radio  communication  and  enhanced  hearing  capabilities.  The  QP  and 
QO  are  similar  in  functionality,  but  have  some  design  differences  that  may  affect  their  usability 
and  quality  of  voice  communications.  They  have  insert  earplugs  (canal  tips)  that  provide  passive 
hearing  protection  and  electronics  that  allow  for  ANR  when  the  ambient  noise  level  exceeds  85 
dBA.  Microphones  are  built  into  the  canal  tips  which  capture  the  speech  of  the  user,  as  well  as 
ambient  sounds.  Two  volume  controls  are  available:  one  for  the  radio  communications  and  one 
for  the  ambient  sounds.  Control  of  the  ambient  sound  level  allows  users  to  decrease  the 
surrounding  noise  levels,  or  increase  desirable  sounds  (e.g.,  somebody  talking  from  a  distance). 
Three  different  sizes  of  canal  tips  were  available  for  the  QP  and  five  different  sizes  for  the  QO. 
Both  systems  had  a  self-check  feature  that  informs  the  user  if  the  canal  tips  are  inserted  properly 
and  are  providing  an  adequate  seal. 


C. 

Figure  2:  Personal  role  radio  (PRR)  with  a)  Standard  headset  (SFI),  b)  Nacre  QuietPro®  ( QP), 

c)  Silynx  QuietOps™  (QO). 
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2.3  Speech  Materials 


Two  tests  of  speech  understanding  were  used.  The  Modified  Rhyme  Test  (MRT)  is  a  test  of 
consonant  discrimination  (Bell  et  ah,  1972),  recommended  by  ANSI  S3.2-1989  (R1999).  A 
sample  of  the  MRT  is  shown  in  Annex  A.  The  listener  was  provided  with  a  typewritten  list  of  50 
sets  of  six  monosyllabic  words  in  the  form  of  consonant-vowel-consonant  (CVC).  Half  of  the 
sets  contrast  the  initial  consonant  (e.g.,  “raw,  paw,  law,  jaw,  thaw,  saw”)  and  the  other  half 
contrast  the  final  consonant  (e.g.,  “teach,  tear,  tease,  teal,  team,  teak”).  The  talker  read  one  word 

from  each  set  embedded  in  a  carrier  phrase  (“The  word  is _ ”)  and  the  listener  circled  the 

word  heard  out  of  the  six  possible  choices.  In  total,  14  different  combinations  of  MRT  word  lists 
were  used  (four  word  lists  with  4-6  combinations  of  target  words  each).  The  word  lists  were 
counterbalanced  across  subject  pairs. 

The  Speech  Perception  in  Noise  test  (SPIN)  assesses  word  recognition  (Kalikow,  Stevens  and 
Elliott,  1977).  A  sample  of  the  SPIN  test  is  shown  in  Annex  B.  Fifty  sentences  were  presented  in 
sequence  by  the  talker  and  the  listener  was  required  to  write  down  the  final  word  in  each.  In  half 
of  the  sentences,  distributed  randomly  throughout  the  list,  the  final  word  was  highly  predictable 
from  the  context.  In  the  remainder,  there  were  no  contextual  cues.  Eight  different  sets  of  50 
sentences  were  used,  counterbalanced  across  subject  pairs.  For  the  MRT  and  SPIN,  guessing  was 
encouraged  and  no  feedback  was  given  about  the  correctness  of  the  responses. 

2.4  Questionnaire 

The  subjects  filled  out  a  questionnaire  for  each  headset,  for  each  experimental  session.  The 
questionnaire  probed  the  usability  and  effectiveness  of  the  three  headsets  for  communication. 

The  questionnaire  is  shown  in  Annex  C.  Subjects  were  asked  to  provide  a  rating  score  for  each 
question  and  to  provide  written  comments. 

2.5  Experimental  Protocol 

Subjects  attended  a  training  session  prior  to  the  commencement  of  the  experimental  sessions. 
They  were  instructed  on  how  to  insert  the  QO  and  QP  canal  tips  in  their  ears  and  to  check  for  a 
proper  fit.  By  going  through  this  process,  the  correct  size  of  canal  tips  for  each  subject  was 
determined.  The  canal  tips  for  each  subject  were  stored  in  separate  envelopes  with  their  subject 
ID  and  they  were  re-used  for  the  experimental  sessions  until  replacement  was  required  (e.g.,  a 
proper  fit  could  no  longer  be  obtained).  The  subjects  were  then  briefed  on  how  to  use  the  PRRs 
and  headsets,  and  practiced  communicating  with  at  least  one  other  subject  in  quiet  and  with  the 
background  noise  on.  Once  the  subjects  had  been  familiarized  with  the  radios  and  headsets,  they 
were  shown  sample  MRT  and  SPIN  lists  and  instructed  on  how  they  should  be  read  in  terms  of 
pronunciation  and  speech  rate.  Subjects  were  then  given  the  opportunity  to  practice  reading  the 
word  lists  with  at  least  one  other  subject,  with  the  background  noise  turned  on. 

Once  the  training  was  completed,  the  five  subjects  were  paired  such  that  all  possible 
combinations  were  tested.  Thus,  each  subject  participated  in  four  experimental  sessions,  and  a 
total  of  10  sessions  were  conducted.  Each  experimental  session  for  a  given  subject  were 
separated  by  a  period  of  one  week  to  minimize  possible  carry  over  of  learning  effects. 

During  the  experimental  sessions,  the  QO  was  set  to  one  level  below  the  default  volume,  and  the 
QP  was  set  to  the  default  volume.  These  volumes  levels  have  anecdotally  been  perceived  as 
being  zero  gain,  or  close  to  a  natural  level  when  listening  to  ambient  sounds.  The  PRR  volume 
level  was  set  to  maximum.  The  experimenter  remained  in  the  control  room  and  listened  over  the 
radio  network  to  monitor  speech  rate,  broken  communication  and  equipment  malfunctions.  The 
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subjects  were  also  monitored  with  a  video  camera.  The  talker  was  only  allowed  to  repeat  if  the 
sentence  was  read  incorrectly  or  the  entire  sentence  was  missed  (e.g.,  due  to  the  talker  not 
pressing  the  push-to-talk  button).  No  repeats  were  allowed  for  reasons  related  to  the  PRR  or 
headset  (e.g.,  excessive  noise  or  dropouts  in  the  communication  channel),  except  in  the  case  of 
battery  failure. 

The  subjects  fitted  themselves  with  the  headset  and  were  seated  as  shown  in  Figure  1.  With  the 
background  noise  turned  on  (75  dBA  pink  noise),  the  talker  read  through  one  MRT  list  and  one 
SPIN  list  while  the  listener  recorded  their  responses  on  paper.  The  subjects  then  switched  roles 
and  repeated  the  procedure.  Upon  completion,  the  experimenter  turned  off  the  noise  and 
administered  the  questionnaire  for  that  headset.  The  subjects  were  then  fitted  with  the  next 
headset,  and  the  procedure  was  repeated  until  all  three  headsets  had  been  used.  The  order  of  the 
headsets  was  counterbalanced  across  subject  pairs. 


2.6  Data  Analysis 

This  study  is  a  within-subject  repeated  measures  design.  Each  of  the  five  subjects  participated  in 
four  sessions  such  that  all  possible  subject  pairs  were  used.  The  MRT  and  SPIN  scores  for  each 
subject  (listeners)  were  averaged  across  the  four  sessions  (talkers).  Repeated  measures  analyses 
of  variance  (ANOVA;  Daniel,  1983)  were  performed  on  the  averaged  SPIN  and  MRT  scores 
using  SPSS  Statistics  17.0  (Statistical  package  for  social  sciences,  SPSS  Inc.,  2008).  Statistical 
significance  was  set  at  p  <  0.05.  For  the  MRT  data,  the  dependent  variables  were  headset  type 
(SH,  QO  and  QP)  and  position  of  contrasting  consonant  (initial  and  final).  For  the  SPIN  data,  the 
dependent  variables  were  headset  type  and  context  (none  or  high).  Post-hoc  pairwise 
comparisons  for  headset  were  computed  using  Fisher’s  least  significant  difference  (LSD). 

Subjective  user  acceptance  scores  for  each  headset  were  calculated  based  on  the  questionnaire 
responses  (Annex  C).  Each  subject  completed  the  questionnaire  four  times  for  each  headset  (once 
per  session),  so  each  headset  was  rated  a  total  of  20  times.  The  score  for  each  question  ranged 
from  1  (completely  unacceptable)  to  7  (completely  acceptable).  The  average  scores  for  each 
question  were  added  to  give  a  total  user  acceptance  score  for  each  headset.  Because  the 
questionnaire  and  rating  scale  were  not  validated  measures,  they  were  not  subjected  to  statistical 
analysis. 
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3  Results 


Repeated  measures  ANOVA  indieated  that  there  were  no  signifieant  differenees  between  hearing 
thresholds  for  the  left  and  right  ears  within  subjects.  The  mean  hearing  thresholds  were  7.9,  -0.9, 
-0.6,  -1.8,  2.0  and  -0.2  dBHL  for  250,  500,  1000,  4000  and  8000  Hz,  respectively  with  standard 
deviations  ranging  from  4  to  8  dB. 

The  results  for  the  MRT  are  shown  in  Table  1.  A  repeated  measures  ANOVA  applied  to  these 
data  showed  a  main  effect  of  headset  (p  <  0.00004)  but  no  main  effect  of  consonant  position.  The 
highest  accuracy  (percentage  correct)  was  obtained  with  the  SH,  followed  by  QP  and  QO.  Post- 
hoc  pairwise  comparisons  using  Fisher’s  least  significant  difference  revealed  significant 
differences  between  all  pairs  of  the  headsets  (SH  and  QO,  p  <  0.001;  SH  and  QP,  p  <  0.035;  QO 
and  QP,  p  <  0.003). 


Table  1:  MRT  results  (percentage  correct  and  standard  deviation)  for  the  three  headsets. 


Standard  Headset 
(SH) 

Silynx  Quiet  Ops^^ 
(QO) 

Nacre  Quiet  Pro® 

(QP) 

Initial  consonant 

89.9  ±2.5 

69.7  ±5.0 

81.8±3.3 

Final  consonant 

88.3  ±4.1 

70.1  ±5.6 

84.6  ±5.1 

The  results  for  the  SPIN  test  are  shown  in  Table  2.  A  repeated  measures  ANOVA  applied  to 
these  data  showed  a  main  effect  of  headset  (p  <  0.001)  and  contextual  cues  (p  <  0.001)  and  their 
interaction  was  significant  (p  <0.001).  Similar  to  the  MRT,  the  most  accurate  result  in  terms  of 
percentage  correct  was  obtained  with  the  SH,  followed  by  the  QP  and  QO.  Post-hoc  pairwise 
comparisons  using  Fisher’s  LSD  revealed  significant  differences  between  all  pairs  of  headsets 
(SH  and  QO,  p  <  0.007;  SH  and  QP,  p  <  0.035;  QO  and  QP,  p  <  0.017). 


Table  2:  SPIN  results  (percentage  correct  and  standard  deviation)  for  the  three  headsets. 


Standard  Headset 
(SH) 

Silynx  Quiet  Ops^^ 
(QO) 

Nacre  Quiet  Pro® 

(QP) 

High  contextual  cues 

99.6  ±0.5 

87.0  ±9.8 

96.9  ±2.7 

No  contextual  cues 

86.8  ±4.1 

52.4  ±  12.4 

77.6  ±  10.6 

For  the  questionnaire  data,  the  average  scores  for  each  question  were  added  to  give  a  total  user 
acceptance  score  for  each  headset.  The  results  are  listed  in  Table  3.  The  highest  total  score  was 
given  to  the  QP  (48.8),  followed  closely  by  the  SH  (47.6).  The  QO  was  rated  relatively  lower 
than  the  other  two  headsets  (35.9). 
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Table  3:  Subjective  user  acceptance  scores  (and  standard  deviation). 


Standard  Headset 
(SH) 

Silynx  Quiet  Ops^^ 
(QO) 

Nacre  Quiet  Pro® 

(QP) 

Overall  ease  of  use 

6.3  ±  1.1 

5.1  ±  1.1 

6.1  ±0.6 

PTT  (push-to-talk) 
button  ease  of  use 

6.0  ±  1.2 

4.6  ±  1.4 

6.4  ±0.8 

Earphone/Fleadset 

comfort 

6.1  ±  1.1 

4.4  ±  1.7 

5.8  ±  1.0 

Speech  fidelity 
(speech  distortion) 

6.1  ±  1.1 

4.1  ±  1.6 

5.6  ±  1.2 

Clarity  of 
communication 
(noise  in  the  channel) 

5.9±  1.3 

4.5  ±2.1 

6.3  ±  1.0 

Continuity  of 
communication 

6.1  ±  1.1 

5.0±  1.7 

6.2  ±0.7 

Annoyance  due  to 
ambient  noise 
( 1  =  highly  annoying, 

7  =  not  annoying) 

5.3  ±  1.4 

4.4  ±  1.7 

6.3  ±  1.0 

Overall  rating 

6.0±  1.1 

4.0±  1.8 

6.3  ±  1.0 

TOTAL  SCORE 

47.6  ±  9.4 

35.9  ±13.0 

48.8  ±  7.3 

The  questionnaire  comments  indicated  that  the  SH  was  easy  to  use,  comfortable  to  wear,  and 
generally  provided  clear  communication.  There  were  a  few  comments  about  the  movement  of  the 
boom  microphone,  which  may  have  caused  broken  speech  transmission.  For  the  QO,  users 
commented  that  the  speech  was  muffled  or  unclear,  the  PTT  button  was  difficult  to  use  (resulting 
in  broken  communication)  and  the  canal  tips  were  uncomfortable  for  long-term  wear.  User 
comments  on  the  QP  indicated  that  the  canal  tips  were  difficult  to  fit,  but  acceptably  comfortable 
once  they  were  inserted  properly.  There  were  mixed  comments  on  the  speech  clarity  and 
noisiness  of  the  channel.  Overall,  the  comments  indicated  that  the  SFI  was  preferred,  the  QP  was 
acceptable  and  the  QO  was  generally  not  acceptable. 
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4  Discussion 


The  main  objective  of  this  experiment  was  to  evaluate  the  quality  of  radioed  speech  in  noise  using 
two  integrated  hearing  protection  headsets,  and  compare  them  to  a  standard  radio  headset  that 
does  not  provide  hearing  protection.  A  secondary  objective  was  to  obtain  feedback  from  the 
users  on  the  headsets  such  that  subjective  user  ratings  could  be  obtained.  The  results  show  that 
for  the  MRT,  subjects  performed  the  best  using  the  SH  (89%)  followed  by  the  QP  (83%)  and  then 
the  QO  (70%).  Performance  was  similar  for  the  SPIN,  with  average  scores  of  93%  for  the  SH, 
87%  for  the  QP  and  70%  for  the  QO.  Performance  on  both  of  the  speech  intelligibility  tests  was 
significantly  better  using  the  SH  than  both  the  QP  and  QO.  However,  the  mean  user  acceptance 
score  was  the  highest  for  the  QP,  followed  closely  by  the  SH.  Both  were  relatively  much  higher 
than  the  QO.  The  largest  difference  in  ratings  for  the  QP  and  SH  was  given  for  “annoyance  due 
to  ambient  noise.”  The  QP  was  given  a  better  rating  because  of  the  integrated  hearing  protection. 
Given  that  military  personnel  will  be  required  to  wear  hearing  protection  in  most,  if  not  all, 
operational  environments,  of  the  three  headsets  tested  the  QP  provided  the  best  combination  of 
speech  quality,  hearing  protection  and  usability. 

Because  integrated  hearing  protection  headsets  such  as  the  QP  are  expensive,  it  may  not  be 
practical  to  use  them  in  all  scenarios.  It  is  important  to  consider  lower-cost  solutions.  One 
possible  solution  is  to  use  the  PRR  in  combination  with  an  earplug.  Two  types  of  earplugs  that 
have  been  evaluated  in  previous  studies  are  the  E-A-R®  Combat  Arms  and  the  Surefire  EP3  Sonic 
Defender™  (Abel  and  Earn,  2004;  Abel  and  Nakashima,  2008). 

The  E-A-R®  Combat  Arms  hearing  protector  is  comprised  of  two  plugs,  attached  end-to-end. 

One  plug  provides  conventional,  level-independent  sound  attenuation.  The  other  plug  contains 
and  orifice  that  allows  low-level  sounds  to  pass  but  impedes  high-level  impulse  noise  (e.g.,  from 
blasts  or  gunfire).  The  Surefire  EP3  Sonic  Defender™  offers  a  similar  capability  through  the  use 
of  a  cap  that  can  be  left  open  or  closed  to  expose  or  block  the  orifice  (Figure  3).  The  plugs  can  be 
worn  underneath  a  communication  headset  earcup  with  the  orifices  exposed  to  allow  the  user  to 
hear  the  radio  traffic.  A  pilot  test  was  done  with  a  single  pair  of  subjects  using  the  standard 
headset  in  combination  with  these  earplugs.  The  earplugs  were  worn  in  the  level-dependent  mode 
(orifice  open  for  the  Surefire,  yellow  plug  inserted  for  the  Combat  Arms).  The  results  suggested 
that  subjects  may  perform  the  same  or  better  with  the  addition  of  earplugs  (Table  4).  It  may  be  of 
interest  to  further  investigate  speech  intelligibility  using  the  standard  headset  in  combination  with 
different  types  of  earplugs. 


Figure  3:  Left  -  Surefire  EPS  Sonic  Defender™  earplugs;  Right  -  E-A-R^  Combat  Arms  earplug. 
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Table  4:  Results  for  pilot  test  using  earplugs  for  a  single  pair  of  subjects. 


MRT  (%  correct) 

SPIN  (%  correct) 

SH 

E-A-R® 

Combat 

Arms 

Surefire 

EPS  Sonic 
Defender™ 

SH 

E-A-R® 

Combat 

Arms 

Surefire 

EPS  Sonic 
Defender™ 

Subject  A 

78 

84 

88 

78 

98 

100 

Subject  B 

92 

96 

98 

92 

98 

96 
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5  Conclusion 


The  highest  scores  on  the  MRT  and  SPIN  tests  in  noise  were  obtained  using  the  standard  PRR 
headset  (SH),  followed  by  the  QuietPro®  (QP)  and  the  QuietOps™  (QO).  User  comments  on  the 
questionnaire  indicated  preference  for  SH,  with  QP  being  acceptable  and  QO  being  unacceptable. 
Total  user  acceptance  rating  scores  were  highest  for  the  QP,  followed  closely  by  the  SH.  Both 
had  relatively  higher  scores  than  the  QO.  Given  that  hearing  protection  will  be  required  in  most 
operational  environments,  the  QP  provided  the  best  combination  of  speech  quality,  hearing 
protection  and  usability.  If  the  QP  is  not  an  affordable  option,  it  may  be  possible  to  obtain  a 
similar  level  of  performance  with  the  combination  of  level  dependent  earplugs  and  the  SH.  This 
option  should  be  further  investigated. 
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Annex  A  Sample:  Modified  Rhyme  Test 


Modified  Rhyme  Test  Form _ Version 

Speaker  Sub  no.: _  Listener  Sub  no.:  _ 

Date:  Fleadset 


1 

but 

bug 

bus 

14 

map 

mat 

math 

27 

wed 

fed 

bed 

40 

cake 

came 

cave 

buff 

bun 

buck 

mad 

mass 

man 

led 

shed 

red 

cane 

case 

cape 

2 

kin 

kid 

kick 

15 

hop 

cop 

shop 

28 

sane  sake  safe 

41 

fang 

bang 

hang 

king 

kit 

kill 

mop 

pop 

top 

save  same  sale 

sang 

gang 

rang 

3 

peak 

peach 

peas 

16 

sack 

sad 

sap 

29 

pit 

pin 

pig 

42 

law 

saw 

paw 

peal 

peace 

peat 

sag 

sat 

sass 

pill 

pick 

pip 

jaw 

raw 

thaw 

4 

dig 

wig 

big 

17 

say 

pay 

may 

30 

heel 

peel 

keel 

43 

rake 

rate 

ray 

fig 

pig 

rig 

gay 

way 

day 

feel 

eel 

reel 

raze 

race 

rave 

5 

fold 

sold 

gold 

18 

heath 

heave 

heap 

31 

toil 

boil 

foil 

44 

dip 

dim 

din 

hold 

cold 

told 

heat 

heal 

hear 

coil 

oil 

soil 

dill 

did 

dig 

6 

kick 

lick 

sick 

19 

tame 

came 

fame 

32 

fig 

fizz 

fit 

45 

tear 

teal 

teak 

tick 

wick 

pick 

same 

name 

game 

fib 

fin 

fill 

team 

tease 

teach 

7 

path 

pack 

pass 

20 

page 

pane 

pace 

33 

mark 

bark 

dark 

46 

tin 

fin 

sin 

pat 

pad 

pan 

pave 

pale 

pay 

lark 

hark 

park 

win 

pin 

din 

8 

beat 

beak 

beach 

21 

dust 

gust 

must 

34 

bash 

bat 

ban 

47 

seethe 

seek 

seen 

beam 

bean 

bead 

bust 

just 

rust 

back 

bath 

bad 

seed 

seep 

seem 

9 

pot 

hot 

lot 

22 

pun 

puff 

pup 

35 

will 

hill 

kill 

48 

run 

bun 

fun 

not 

tot 

got 

pub 

pus 

puck 

bill 

fill 

till 

sun 

nun 

gun 

10 

fit 

hit 

bit 

23 

then 

den 

ten 

36 

pale 

sale 

bale 

49 

neat 

beat 

seat 

sit 

kit 

wit 

pen 

hen 

men 

gale 

male 

tale 

meat 

feat 

heat 

11 

sup 

sub 

sud 

24 

cuss 

cud 

cup 

37 

duck 

dud 

dung 

50 

lip 

hip 

dip 

sum 

sun 

sung 

cut 

cub 

cuff 

dun 

dug 

dub 

sip 

rip 

tip 

12 

dent 

tent 

rent 

25 

hook 

shook 

book 

38 

sit  sip 

sill 

went 

sent 

bent 

took 

cook 

look 

sick  sin 

sing 

13 

best 

west 

nest 

26 

late 

lake 

lay 

39 

tack 

tan 

tab 

vest 

test 

rest 

lame 

lane 

lace 

tang 

tarn 

tap 

DRDC  TORONTO  TR  2009-074 


13 


Annex  B  Sample:  Speech  Perception  in  Noise 
(SPIN) 


Form  #  -1  of  the  Revised  SPIN  Test  (12/83) 

Sub  no. _  Marker _  Date _ 

#C-High _ #C-Low _ 


1 .  His  plans  meant  taking  a  big  RISK. 

H 

2.  Stir  vour  coffee  with  a  SPOON. 

3.  Miss  White  won’t  think  about  the  CRACK. 

H 

L 

4.  He  would  think  about  the  RAG. 

5.  The  plow  was  pulled  by  an  OX. 

H 

L 

6.  The  old  train  was  powered  bv  STEAM. 

7.  The  old  man  talked  about  the  LUNGS. 

H 

L 

8.  I  was  considering  the  CROOK. 

9.  Let’s  decide  bv  tossing  a  COIN. 

H 

L 

10.  The  doctor  prescribed  the  DRUG. 

H 

1 1 .  Bill  might  discuss  the  FOAM. 

L 

12.  Nancy  didn’t  discuss  the  SKIRT. 

13.  Hold  the  babv  on  vour  LAP. 

H 

L 

14.  Bob  has  discussed  the  SPLASH. 

L 

15.  The  dog  chewed  on  a  BONE. 

1 6.  Ruth  hopes  he  heard  about  the  HIPS. 

H 

L 

1 7.  The  war  was  fought  with  armored  TANKS. 

18.  She  wants  to  talk  about  the  CREW. 

H 

L 

19.  They  had  a  problem  with  the  CLIFF. 

20.  They  drank  a  whole  bottle  of  GIN. 

H 

L 

21.  You  heard  Jan  called  about  the  VAN. 

22.  The  witness  took  a  solemn  OATH. 

H 

L 

23.  We  could  consider  the  FEAST. 

L 

24.  Bill  heard  we  asked  about  the  HOST. 

25.  They  tracked  the  lion  to  his  DEN. 

H 

L 

26.  The  cow  gave  birth  to  a  CALF. 

27.  I  had  not  thought  about  the  GROWL. 

H 

L 

28.  The  scarf  was  made  of  shiny  SILK. 

H 

29.  The  super  highway  has  six  LANES. 

30.  He  should  know  about  the  HUT. 

H 

L 

3 1 .  For  dessert  he  had  apple  PIE. 

H 

32.  The  beer  drinkers  raised  their  MUGS. 

33.  I’m  glad  you  heard  about  the  BEND. 

H 

L 

34.  You’re  talking  about  the  POND. 

35.  The  rude  remark  made  her  BLUSH. 

H 

L 

36.  Nancy  had  considered  the  SLEEVES. 

37.  We  heard  the  ticking  of  the  CLOCK. 

H 

L 

38.  He  can’t  consider  the  CRIB. 

L 

39.  He  killed  the  dragon  with  his  SWORD. 

40.  Tom  discussed  the  HAY. 

H 

L 
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4 1 .  Mary  wore  her  hair  in  BRAIDS. 

42.  She’s  glad  Jane  asked  about  the  DRAIN. 

43.  Bill  hopes  Paul  heard  about  the  MIST. 

44.  We’re  lost  so  let’s  look  at  the  MAP. 

45.  No  one  was  injured  in  the  CRASH. 

46.  We’re  speaking  about  the  TOLL. 

47.  My  son  has  a  dog  for  a  PET. 

48.  He  was  scared  out  of  his  WITS. 

49.  We  spoke  about  the  KNOB. 

50.  I’ve  spoken  about  the  PILE. 


H 

H 

H 

H 


L 

L 


L 


L 

L 
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Annex  C  Questionnaire 


Effects  of  Integrated  Hearing  Protection  Headsets  on  the 
Intelligibility  of  Radio  Communications 

Subject  ID: 

Date: 

System  Used  (circle  one):  PRR  Nacre  QuietPro  Silynx  QuietOps 

Barely 

Unacceptable 

Barely 

Acceptable 

Completely 

Unacceptable 

E  SHE  HE 

Completely 

Acceptable 

Reasonably 

Unacceptable 

Borderline 

© 

Reasonably 

Acceptable 

Rate  The  Following 
Features: 

User  Acceptance  Rating 

Comments: 

1 

2 

3 

4 

5 

6 

7 

Overall  ease  of  use 

0 

0 

0 

0 

0 

0 

0 

PTT  (push-to-talk)  button  ease 
of  use 

0 

0 

0 

0 

0 

0 

0 

Earphone  /  Headset  comfort 

0 

0 

0 

0 

0 

0 

0 

Speech  fidelity 

(i.e.  was  the  speech  distorted? 

0 

0 

0 

0 

0 

0 

0 

Clarity  of  communication 
(i.e.  was  the  channel  noisy?) 

0 

0 

0 

0 

0 

0 

0 

Continuity  of  communication 
(i.e.  was  the  speech  broken?) 

0 

0 

0 

0 

0 

0 

0 

Annoyance  due  to  ambient 
noise 

0 

0 

0 

0 

0 

0 

0 

Overall  Rating 

0 

0 

0 

0 

0 

0 

0 
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List  of  symbols/abbreviations/acronyms/initialisms 


ANOVA 

Analysis  of  Variance 

ANR 

Active  Noise  Reduction 

ANSI 

American  National  Standards  Institute 

CF 

Canadian  Forces 

CVC 

Consonant-V  owel-Consonant 

dB  HL 

Decibels,  Hearing  Level 

dBA 

Decibels,  A-weighted 

DRDC 

Defence  Research  &  Development  Canada 

HPD 

Hearing  Protection  Device 

Hz 

Hertz 

IHPH 

Integrated  Hearing  Protection  Headset 

kHz 

Kilohertz 

LFCA 

Land  Force  Central  Area 

MRT 

Modified  Rhyme  Test 

PRR 

Personal  Role  Radio 

QO 

Silynx  QuietOps^'^  headset 

QP 

Nacre  QuietPro®  headset 

SH 

Standard  Headset  for  Personal  Role  Radio 

SPIN 

Speech  Perception  in  Noise  test 
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